piece by piece
In stages, gradually, as in
He took the clock apart piece by piece
, or
Let's go over your exam paper, piece by piece
. Also see
bit by bit